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We investigate collective synchronization in a system of coupled oscillators on small- world net- 
works. The order parameters which measure synchronization of phases and frequencies are intro- 
duced and analyzed by means of dynamic simulations and finite-size scaling. Phase synchronization 
is observed to emerge in the presence of even a tiny fraction P of shortcuts and to display satu- 
rated behavior for P > 0.5. This indicates that the same synchronizability as the random network 
(P = 1) can be achieved with relatively small number of shortcuts. The transient behavior of the 
synchronization, obtained from the measurement of the relaxation time, is also discussed. 

PACS numbers: 89.75.Fb, 05.45.Xt 



Systems of coupled nonlinear oscillators, which serve 
as prototype models for various oscillatory systems in 
nature, have attracted much attention. Those systems 
exhibit remarkable phenomena of collective synchroniza- 
tion, which have been observed in a variety of physical, 
biological, and chemical systems [jl|. Up to date, existing 
studies on collective synchronization have mostly been 
performed either on the local regular networks such as 
e?-dimensional cubic lattices or on the globally connected 
geometry. In recent years, there has been suggested the 
possibility that a number of diverse systems in nature 
may have the same topological structure as the small- 
world networks S, which are intermediate of the local 
regular networks and the fully random networks. Such 
small-world networks are usually characterized by two 
interesting features: high clustering, which is a charac- 
teristic of regular networks, and the short path length, 
which is typically observed in random networks j^j . Most 
studies on small-world networks have been focused on the 
geometrical and topological characterization of the net- 
works, with little attention paid to dynamics defined on 
them. Recently, some studies have considered dynamical 
systems put on small- world networks where such 

desirable features as faster propagation of information, 
better computational power, and stronger synchroniz- 
ability have been observed. In Ref. ||, frequency syn- 
chronization on the small-world network has been no- 
ticed in the presence of a small amount of randomly 
rewired connections and the possibility of the transi- 
tion to global entrainment with the mean-field nature 
has been pointed out. However, quantitative analysis 
has not been performed and proper understanding is still 
lacking. For example, the critical rewiring probability 
beyond which true long-range order is present at finite 
coupling strength has not been addressed. 

In this paper we study the detailed aspects of the 
collective synchronizations on small-world networks, as 
the rewiring probability and the coupling strength are 



varied. In general, frequency synchronization can 
be attained without synchronization of phases, and 
we explore both to investigate the synchronization- 
desynchronization transition. Via careful finite-size scal- 
ing, we find the following: (i) Phase synchronization as 
well as frequency one, which is absent in one-dimensional 
regular networks, emerges in the presence of even a very 
small fraction of shortcuts, (ii) The phase synchroniza- 
tion transition is of the mean-field type, the same as the 
Kuramoto model ||. (iii) The relaxation time mono- 
tonically decreases with the rewiring probability P up 
to P = 0.5 and apparently saturates for P > 0.5. This 
indicates that the time required to synchronize the small- 
world network for P > 0.5 is almost the same as that for 
a random network (P = 1). 

According to Ref. j|, the small- world network is con- 
structed in the following way: First, a one-dimensional 
regular network with only local connections (of range k) 
between the N nodes is constructed. Each local link is 
visited once, and then with the rewiring probability P it 
is removed and reconnected to a randomly chosen node. 
After the whole sweep of the entire network, the total 
number of shortcuts in the network is given by NPk for 
sufficiently large N. At each node of this small-world 
network is located an oscillator; a link connecting two 
nodes represents coupling between the two oscillators at 
those two nodes. Describing the state of the ith oscilla- 
tor, i.e., the one at node i by its phase <pi, we write the 
set of equations of motion governing the dynamics of the 
N oscillator system (i = 1, 2, • • • , N) §: 



(1) 



where A, denotes the set of nodes connected to node i 
(via either local links or shortcuts) and K is the coupling 
strength suitably normalized with respect to the average 
number of connections per node. On the right-hand side 
uji represents the intrinsic frequency of the ith oscillator. 
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They are quenched random variables with the distribu- 
tion function g(uS). 

On the small-world network built in this manner with 
given k and P, we investigate the collective synchroniza- 
tion behavior of the coupled oscillators at various values 
of the coupling strength K. For convenience, the range 
k = 3 is taken and the Gaussian distribution with unit 
variance (a 2 — 1) for g(uj) is used [||. We then use the 
Heun's method with the discrete time step At = 0.05, 
to integrate numerically Eq. Typically, while the 

equations of motion are integrated for N t = 4 x 10 3 
time steps, the data from the first N t /2 steps are dis- 
carded in measuring quantities of interest. Both At and 
Nt have been varied to verify that the measured quanti- 
ties are precise enough and the networks of various sizes, 
up to N — 3200, have been considered. For each network 
size, we have performed one hundred independent runs 
with different configurations of the intrinsic frequencies 
as well as different network realizations, over which av- 
erages have been taken. 

Collective behavior of the oscillator system is conve- 
niently described by the order parameters 
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where (• • •) and [• • •] denote the averages over time and 
over different realizations of the intrinsic frequencies, re- 
spectively, and c is a sufficiently large number. Since the 
frequency resolution is given by (A^Ai) -1 in numerical 
simulations, two oscillators should be regarded as mu- 
tually entrained if the difference in frequency is smaller 
than (JVtAi) -1 . The order parameter q in Eq. (||) docs 
not depend sensitively on the value of c, and we thus 
choose c = 10 6 , which turns out to be sufficient for per- 
ceiving the difference. For comparison, we have also con- 
sidered a different version of the frequency order param- 
eter r = lirn/v^ 00 (./V s /./V), where N s is the number of 
mutually entrained oscillators in the largest cluster ||, 
only to find no essential difference. 

Figures [j] and || display the obtained phase and fre- 
quency order parameters (m and q) versus the coupling 
strength K at various values of the rewiring probability. 
In the weak coupling limit (K — ► 0), phases of the os- 
cillators are distributed uniformly on the interval [0, 27r], 
yielding m = 0(1/ y/N) and the absence of macroscopic 
coherence. On the other hand, in the strong coupling 
limit (K — > oo) all phases of the oscillators become syn- 
chronized, to give m = 1 and accordingly q = 1, regard- 
less of the detailed structure of the network jt| . 

An important observation from Figs. |] and ^ is that 
synchronization of the phase as well as of the frequency 



exhibits strong dependence on the rewiring probability 
P. In particular, both of them do not show synchro- 
nization in the absence of shortcuts (P = 0), which is 
consistent with the known result in a one-dimensional 
system M . When a tiny fraction of the shortcuts comes 
into the system, on the other hand, the dynamics of the 
system changes dramatically, giving rise to phase and fre- 
quency synchronization (compare curves for P — and 
for P = 0.05 in Fig. [I] and|2|). Another interesting feature 
found in Fig. [l]is that as P grows, phase synchronization, 
measured by m(K) in Fig. [j], saturates and does not show 
significant difference for P > P m s 0.5. It is thus indi- 
cated that phase synchronization almost the same as that 
for P — 1.0 can be achieved with relatively small amount 
of shortcuts (P w 0.5). This may have some practical im- 
portance in network systems where making long-ranged 
shortcuts has a high cost of resources. ^From an econom- 
ical point of view, small-world networks with P f» P m is 
favorable: Global coherence is attained with resources 
spent as less as possible. Similar behavior may also be 
expected for the frequency synchronization measured by 
q(K) in Fig. |[ although rather large finite-size effects, 
particularly for small P, tend to obscure such saturation 
behavior of q. 

For comparison, the synchronization behavior in the 
globally-connected network is also displayed in Figs, [j] 
and ||, where good agreement with the analytic expres- 
sion m w 1 — a 2 /2K 2 found in Ref. Jl(]] for large K is 
shown (see the thick solid line labeled by "AN" in Fig. |l|). 
Noting that the number of connections in a small-world 
network is O(N), in sharp contrast with 0(N 2 ) valid in 
the globally-connected network, we naturally expect that 
the phase synchronization on a small-world network sets 
in at the coupling strength larger than the critical value 
K c = 2/ng(0) « 1.60 in a globally-connected network 
[for the Gaussian distribution g(u>) with unit variance] 0. 
Indeed such features are shown in Figs, [j] and ^. Further- 
more, it is noteworthy that qualitatively the same syn- 
chronization behavior is observed for the globally-coupled 
network and the small-world network, which implies that 
strong synchronization can be achieved with only 0(N) 
connections instead of 0(N 2 ). 

Precise determination of the critical coupling strength 
K c separating desynchronized and synchronized states 
requires careful consideration of the finite-size effects. We 
examine finite-size scaling of the phase order parameter 
to determine K c and explore the transition nature around 
it. In the thermodynamic limit the order parameter dis- 
plays the critical behavior 



771 



(K - K c f, 
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with the critical exponent (3. On the other hand, in a 
finite system, we expect m = (K — K c y f(£/N,£/N) 
with a function / of two scaling arguments £/N and 
C/N, where the correlation length £ diverges at K Cl and 
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C (= 1/kP) is an additional length scale corresponding to 
the typical distance between the ends of shortcuts in the 
small- world network Here we pay attention to the 
system with size much larger than £, and approximate the 
above scaling function f(£/N,(/N) as /(£/iV,0). This 
leads to the scaling form of the order parameter 



N-P/»F ({K - K C )N 1/D \ , 



(5) 



where the critical exponent v describes the divergence of 
the correlation volume £v at K c [jjJLfni : 
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(6) 



Since at K = K c the function F in Eq. (g) has a value 
independent of N, one can determine K c by means of 
the standard finite-size scaling analysis. Namely, plot- 
ting mN^l v versus K for various sizes, one can find the 
value of (3/D which gives a well-defined crossing point at 
K c . After (3/v and K c are determined, one then use 
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K, 



in order to obtain the value of {l — (3)/v, which, combined 
with the known value of gives the values of j3 and 
v. 

Figure || shows the determination of K c for the 
globally-connected network through the use of the finite- 
size scaling form in Eq. (^|). Varying the value of fi/v, 
we find that f3/P w 0.25 gives the well-defined cross- 
ing point at K c ps 1.61, which is in a good agreement 
with the analytical result K c = 2/%g(0) sa 1.60 p). In 
the inset of Fig. ||, the least-square fit to Eq. ([?]) gives 
(1 - j3)/v w 0.27, which, combined with w 0.25, 
yields f3 w 0.48 and w 1.92. These results are certainly 
consistent with the fact that the globally-connected net- 
work is a mean- field system, which has (3 = 1/2 and 
v = 1/2 ||; in particular the obtained value of v close to 
2 indicates that the upper critical dimension of the syn- 
chronization transition is four |12|. Similarly, the tran- 
sition behavior on the small-world network may be in- 
vestigated. Shown in Fig. || is the determination of ex- 
ponents and K c for the small-world network with the 
rewiring probability P = 0.2. From the same analysis 
as in Fig. pi we obtain K c w 2.88 together with expo- 
nents j3 ~ 0.51 and v w 2.04, which are essentially the 
same as those in the globally-coupled network. This con- 
cludes that the coupled oscillator system on a small- world 
network with the number of connections given by O(N) 
displays a mean-field synchronization transition, like the 
system on a globally connected network with the much 
larger number of connections 0(N 2 ). 

Figure displays the phase diagram on the plane of 
K and P. The data points on the phase boundary sepa- 
rating synchronized (S) and desynchronized (D) states 



have been obtained from the finite-size scaling analy- 
sis described above. The nature of the synchronization 
transition has always been found to be the mean-field 
type for all values of P used in this work. We find 
that the phase boundary in Fig. [5] is well described by 
the equation K c = 1.64(4) + 0.28(1)P- X . As P -► oo, 
this form predicts K c = 1.64(4), in good agreement with 
K c ~ 1.61 found in Fig. [|and the known analytic result 
K c = 2/ng(0) ~ 1.60 for the globally-coupled network. 
This agreement is somehow expected since the globally- 
coupled network, where the number of long-ranged con- 
nections (shortcuts) is 0(N 2 ), corresponds to P w N. 
Straightforward extrapolation of the estimated form of 
the phase boundary predicts that K c is finite only if 
F ^ 0. Assuming its validity, one expects to have syn- 
chronization on the small-world network at finite cou- 
pling strength unless P is zero. This has close resem- 
blance to the existing studies on the small-world phe- 
nomena: The characteristic path-length in the small- 
world network behaves very differently for P = and 
for F ^ |0. Thus supported is the view that the 
small-world transition and the order-disorder transition 
are intimately related [HJ . 

Meanwhile, the frequency order parameter q is ob- 
served to shift toward larger values of the coupling 
strength K with the increase of the system size N, sus- 
taining its shape and eventually converging. Such pecu- 
liar behavior, which appears more conspicuous at small 
values of P, makes the standard finite-size scaling anal- 
ysis inadequate, leaving the precise value of the criti- 
cal coupling strength for the frequency synchronization 
rather difficult to determine. In particular it is not clear 
whether phase synchronization and frequency synchro- 
nization emerge simultaneously (at the same critical cou- 
pling strength) for all values of the rewiring probability 
P. The rather limited data appear to favor a slightly 
smaller value of the critical coupling strength for fre- 
quency synchronization (at small values of P), suggesting 
the interesting possibility of frequency synchronization 
without phase synchronization for intermediate values of 
the coupling K. For conclusive results, however, more 
extensive simulations are required. 

/From the point of view of information transfer, the 
remarkably short path length observed in a small-world 
network may imply that information flow through all el- 
ements in the network is quite fast. In the present work, 
this can be rephrased as follows: The time it takes to es- 
tablish global synchronization should decrease substan- 
tially as small amounts of shortcuts are introduced. To 
investigate such transient behavior, we start from ran- 
dom initial conditions and measure the phase order pa- 
rameter to as a function of time. The average relaxation 



time 1 16 



dt'rh(t') 



(8) 



3 



is then computed, where the normalized order parameter 
m(t) — m e 



eq 



rn 



m — m e i 



(9) 



with the initial value mo = m(t=0) and the equilib- 
rium value m eq = m(i— >oo) satisfies m(0) = 1 and 
rn(t^oo) = 0. The average relaxation time defined in 
this way is very useful for the systems with many relax- 
ation time scales. Here, for P > 0, we observe that fh(t) 
at long times does not fit well to the exponential decay 
form based on a single relaxation time scale. In Fig. ^ we 
show the relaxation time r m versus P at K = 10. As P 
is increased, r m is shown to decrease up to P « 0.5, and 
then it appears to saturate for P > 0.5. The similarity 
between the phase boundary in Fig. |E| and the relaxation 
time in Fig. [| is striking and suggests almost the same 
synchronization behavior (in both transient and station- 
ary aspects) for all values of P > 0.5. We have also inves- 
tigated the relaxation time T q for frequency synchroniza- 
tion and found that similar saturation appears, as shown 
in the inset of Fig. ^. This reflects the overall similarity 
in achieving both types of synchronization. 

In summary, we have examined collective synchroniza- 
tion in the system of coupled oscillators on small-world 
networks. Both the phase and frequency synchroniza- 
tion have been found to exhibit strong dependence on 
the rewiring probability P, as P is raised from zero. In 
particular, for any nonzero value of P considered here, 
both types of synchronization emerge at finite coupling 
strengths while they are absent at P — 0. This appar- 
ently suggests that the critical value of P, below which 
synchronization does not set in at any finite coupling 
strength, vanishes, although more extensive simulations 
near P = are necessary for conclusive results. The 
phase boundary for the (phase) synchronization transi- 
tion, which is of the mean-field type at any P, has been 
obtained from the finite-size scaling analysis of the phase 
order parameter. The transient behavior of synchroniza- 
tion has also been investigated through the relaxation 
time of the system, i.e., the time taken by the system 
in the desynchronized initial state to reach the final syn- 
chronized state. Both the phase diagram and the relax- 
ation time, measuring the stationary and transient fea- 
tures of synchronization, respectively, display similar sat- 
uration behavior for P > 0.5. ^From a practical point of 
view, this saturation behavior has a useful implication 
on building networks: Since the long-range connection 
usually costs more than the local connection, it is advan- 
tageous to tune P to the value at which the saturation 
begins and to establish globally connected behavior with 
less consumption of resources. Finally, the possibility of 
successive transitions with the coupling strength, one for 
frequency synchronization and the other for phase syn- 
chronization, has been raised at small values of P, the 
detailed investigation of which is left for future study. 
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FIG. 1. Phase synchronization order parameter m as a 
function of the coupling strength K for various values of the 
rewiring probability P in the small-world network with size 
N = 800. For comparison, obtained data and known analytic 
results for the globally-connected network, labeled as "GL" 
and "AN" respectively, are also plotted. The error bars esti- 
mated by the standard deviation have approximately the sizes 
of the symbols and the lines are merely guides to the eye. It 
is shown that phase synchronization appears at all nonzero 
values of P. 
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FIG. 3. Phase synchronization order parameter m for the 
globally coupled network plotted as mN 13 ^ with (3/v = 0.25 
versus K for the network size N = 100, 200, 400, 800, 1600, 
and 3200 (from bottom to top on the right side). There is 
given a unique crossing point at K c ~ 1.61. Inset: From 
Eq. (|), the slope (1 - 0)/v « 0.27 is obtained, which, com- 
bined with j3/v pa 0.25 found in the main panel, results in 
P « 0.48 and v « 1.92. 



q 




2 4 6 8 10 



K 

FIG. 2. Frequency synchronization order parameter q ver- 
sus K for various values of P in the small- world network with 
size N = 800. The results of the globally-connected network 
are also plotted for comparison. Error bars represent stan- 
dard deviations and lines are guides to the eye. Frequency 
synchronization is shown to emerge at all nonzero values of 
P. 




1 2 3 4 5 



K 

FIG. 4. Phase synchronization order parameter m for the 
small-world network with P — 0.2 plotted as mN 13 ^ 1 ' with 
P/v — 0.25 versus K, displaying one unique crossing point at 
K c « 2.88 [TV = 100, 200, 400, 800, 1600, and 3200 from bot- 
tom to top on the right side] . Inset: (1 — /3)/u ft! 0.24 is found 
from the slope. Analysis similar to that in Fig. ^ leads to the 
same mean-field exponents j3 ~ 0.5 and u m 2.0. 
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FIG. 5. Phase diagram of the oscillator system on a 
small- world network. The data points on the phase boundary 
have been obtained from the finite-size scaling form of the 
order parameter in Eq. (@). The phase boundary, separating 
the synchronized (S) state from the desynchronized (D) one, 
is well described by the equation K c = 1.64(4) + 0.28(1)P~\ 
represented by the dotted line. 
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FIG. 6. Relaxation time r m of the phase synchronization 
order parameter (in arbitrary units) versus P for K = 10. It 
is manifested that r m — > oo as P — » 0. Error bars represent 
standard deviations and the line is merely a guide to the eye. 
Inset: Relaxation time r q for frequency synchronization (in 
arbitrary units) versus P for K = 10. 
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